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Abstract Let {Xn} be an integer valued Markov Chain with finite state space. Let Sn = "^^—q £^nd let L„ (x) 
be the number of times Sk hits x £ Z up to step n. Define the normalized local time process In {t, x) by 

In {t,Xj = -= , X eR. 

The subject of this paper is to prove a functional, weak invariance principle for the normalized sequence In {t, x) ,i.e. 
we prove under the assumption of strong aperiodicity of the Markov Chain that the normalized local times converge 
in distribution to the local time of the Brownian Motion. 



1 Introduction. 

Let S C Z be a finite set, P : 5 x 5 — >■ [0, 1] an irreducible, aperiodic stochastic matrix. Let /i be some distribution 
on 5 and let {Xi}°Zf^ be a Markov Chain generated by P and the initial distribution n, i.e. Xj, i = 0, 1, 2, ... are 
random variables defined on a probability space {X, B, P^), taking values in S, such that the equality 



P^(X,, =si,X,, =S2,..., =sn)= f^so-P'' (so,si) -P*^-'^ (si , sa ) .. . ■ P'" ^ (s„_i , s„) , 

sqGS 

holds with fis = • Under these assumptions, P has a unique P-invariant probability distribution vector v, in 

the sense that the equality i/P = v holds. 

We may assume that for every initial distribution /i, X = S''^, B is the Borel a-field generated by cylinders of the 
type [soSi...Sn] = {cj G : cj^ = s^, i = 0, 1, n} and Xi (uj) = uji. 
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Set 



" 1 



k=0 

Let J] , Z)-(- and D denote the spaces of functions defined on [s, i\, [0, oo) and R respectively, that are continuous 
on the right with left limits at each point (Cadlag functions). £^[s,t], ^+ and D endowed with the Skorokhod Ji 
topology and its suitable generalization to [0, oo) and R, constitute Polish (complete and separable metrizable) spaces 
(see [3]). 

Under the assumption that (-'^o) = 0, the weak invariance principle for the sequence Wn holds for any initial 
distribution fi, i.e. the process Wn (t) regarded as a sequence of random variables defined on {X,B, P^) and taking 
values in _D+ converges in distribution to the Brownian motion, henceforth denoted by Wa (t) , where 

a'^ = Var(Wa(l)) = lim 

ji— >-oo n 

is the asymptotic variance of the process Sn with respect to the initial distribution u. Now, a'^ = if and only if X 
is a coboundary, meaning that there exists a square integrable process Y = {Yn} such that (see [121 Lemma 6] or [71 
II.3 Thm.A]) 

In this case the functional Umit of Wn is degenerate, so we restrict our attention to the case when > 0. The 
invariance principle may be proved by techniques used in this article, or otherwise, see [3]. 

Let Ln{x) = {k < n : Sjf^ = x} = X]fc=o ^{x} i^k) denote the number of arrivals of the process {S'fcl^gpj at the 
point X after n steps, and let ln{t, x) = -^L[„j] ([y'na:]), {t,x) £ [0, oo] xM.. In {t, x) is the amount of time multiplied 

by -^n that the process Wn (•) spends up to the time instant t at the point ^^^^-^ . 

Let I {t,x) be the local time of the Brownian motion Wa- (■) at time t, i.e. I (■, ■) is a random function satisfying 
the equality 

Jl{t,x)dx=l lji{Wait))dt 

for every Borel set A G and t G [0, oo], P - a.s where P is the Wiener measure on C(R), the space of continuous 
functions on R (see |llj). 

Note, that for every t>0, the sequence In {t,x) defines a D valued process on X. Since, l{t,-) is a.s. continuous 
on R, we may also regard it as a _D valued random variable. 

In this paper, we prove that under the assumption that the Markov chain is strongly aperiodic (see definition [T]) 
, the weak invariance principle for Wn (i) implies an invariance principle for the local times, i.e. the convergence in 
distribution of Wn to Wa implies that In {t, x) converges to / {t, x) (here, convergence is in the sense that there exists 
a probability space where In (t, x) converges to I (t, x) uniformly on compact sets). The case when Xj's are i.i.d's was 
treated by Borodin [4], under the assumption that for every t ^ 2nZ, Se**^' ^ 1, an assumption which we refer 
to as non-arithmeticity. We also show that the assumption of strong aperiodicity may be exchanged for the weaker 
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assumption of non-arithmeticity in the i.i.d case, and for a certain class of Markov chains (see the remark following 
Definition [!}. 

Conventions and Notations: 

— denotes the measure P^, where fj, assigns mass 1 to the point x £ S. 

— denotes integrals on 5* with respect to the measure and by integrals with respect to the measure P^. 

— For two random variables X and Y , X = Y means that X and Y are equally distributed. Also Xn =i X means 
that Xn converges in distribution to X. 

— denotes the space of complex valued functions on S, which is isomorphic to C" with n = 

— denotes the space of linear operators from C"^ into itself, and we denote by ||-|| the operator norm on this 
space. 

— Throughout the paper we assume that P is aperiodic and irreducible, v always denotes the stationary distribution 
with respect to P. 

2 Statement of the Main Theorem. 

Before stating the main theorem we introduce the notion of strong aperiodicity (see [§]): 
Definition 1 A function f : S x S ^ Z is said to be aperiodic if the only solutions for 



with t G K, \\\ = 1, (f €z C , \ip\ = 1 are t G 27rZ, ip = const, f is is said to be periodic if it is not aperiodic. 
Since, we are only interested in the case f {x,y) = y, which gives f {Xn-i, Xn) = Xn, we say that the Markov 
Chain {Xn} is strongly aperiodic iff the function f {x,y) = y is aperiodic. 

The assumption of strong aperiodicity may be dropped in case {Xi} is a sequence of i.i.d's and may be dropped 
in the Markov case provided that the underlying Markov shift is almost onto (see section [7|. Note that strong 
aperiodicity of the Markov Chain implies aperiodicity of the stochastic matrix P, while the reverse implication is 
generally false - a simple random walk where Xn equals ±1 with equal probability may serve as a counter example. 
Here for t = n, X = —1 and ip = 1, 

e " = -1, 

hence Xn is not strongly aperiodic. However 



Mx, y £ S, such that P"" (y) > 




is aperiodic. For discussion of condition [T] in a more general setting, see [2]. 
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Theorem 1 Let {Xn} be an irreducible, strongly aperiodic, finite state Markov chain. Assume that E'^ {Xq) = 
and 

Wn ^Wa, a > 0. 

Then there exists a probability space (X',S',P') and processes W^, : X — )■ _D+ such that: 

1. Wn = Wl^; Wa=W!y. 

2. With probability one Wn converges to W'a uniformly on compact subsets o/[0,oo). 

3. For every e,T > the processes I'n {t, x) and I' (t, x) defined with respect to Wn and Wly satisfy the relationship: 

lim P' ( sup \l'n{t,x)-l' {t,x)\> e] =0. (2.1) 
\te[o,T]..xeR J 

We start by fixing tlie time variable at 1, and for convenience denote: tn {x) = ln{l,x) and t (x) = / (1, x) . The main 
step on tlie road to proving the previous theorem is to prove: 

Theorem 2 Let {Xn} be a finite state Markov chain, E'^ {Xq) = and 

Wn AWa, CJ> 0, 

then 

d 

tn =r" t(j. 

In order to prove convergence in distribution of {tn{x)}, we have to establish relative compactness of the family 
n = {tn {^)}n&i ' '*^hich by definition means that every sequence of elements from 71 has a subsequence that 
converges in distribution. This is done in section [5] Then to complete the proof, in section 15.31 we show that ta (x) 
is the only possible distributional limit point. 

Organization of the paper: 

We begin with the proof under the assumption that Xn is strongly aperiodic. Section |3] contains estimates of the 
characteristic functions of the relevant processes, which are later used, in section |4] to carry out the calculations 
needed for the proof of Theorem[2l In sections[5]and[6]we prove Theorems [2] and [1] respectively under the assumption 
of strong aperiodicity. 

In Section [7] we show the modifications needed to extend these results to the periodic case. 

This work was motivated by Aaronson's work on random walks in random sceneries with independent jump 
random variables. In section [8] we explain the model of RWRS and why Theorem [T] implies Aaronson's result for 
RWRS with the distribution of a strongly aperiodic Markov Chain. 

3 The Characteristic Function Operator Q(t) 

From the irreducibility of P it follows that there is a unique probability distribution v on S, such that vP = v. This 
is equivalent to 1 being a simple eigenvalue of P, with a right-hand eigenspace of vectors in C'^ having equal entries. 
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Moreover, from aperiodicity of P it follows that all other eigenvalues of P are of modulus strictly less than 1. The 
projection to the eigenspace belonging to 1 is given by {v, ■) 1 = (•) 1 (here, 1 is a vector in C"^ with all entries 
equal to 1). In what follows, we omit the 1, so that depending on the context E'^ (/) may denote both a scalar, or a 
vector in C'^ with all entries equal to E'^ (/). Hence, we can write 

Pf = E" (/) + Nf, 

where A*' is an operator with spectral radius p{N) strictly less then 1. It follows that for every p{N) < rj < 1, and 
n large enough, we have 

I Ar?^ II ^ n 

W — ^ ■ 

Let Q (t) : C — > £g be an operator valued function defined by 

Q{t)f{x):= I e^'y f {y)V^ [dy) = E- (e^'''^ f) =Y^ P {x,y) e^'^ f [y) . 

s 

Note that Q (0) = P. 

Since, S is a finite state space, it is easy to see that the function Q (t) is holomorphic and its derivatives are given 

by 

(§^Q (t) f) {x) = i" / y^e^'yf {y) {dy) =i^Y. ^^"^ y) ' 

\ ^ J yfZS 

Let 

< {t) = E^ (e"^") , < {ti,t2) = E'' (^e't^SMX^^ 

denote the characteristic functions of the processes Sn and {Sn, Xn) respectively, under the initial distribution /i. 
Our primary interest in Q {t) is due to the fact that ip!^ (t) = (Q (f)" l) , and yiJt (ti, = -E^ (Q (ti)" e**^") . 



3.1 Expansion of the largest eigenvalue. 

It may be shown using standard perturbation techniques (see [5] or [T] Chapter 3]) that the largest eigenvalue of Q [t) 
and its eigenspaces are analytic functions of f in a neighborhood of 0. More precisely, we have that in a neighborhood 
I of 0, Q{t) has a simple eigenvalue A (t) which is an analytic perturbation of A(0), and there is a positive gap 
between A (t) and all other eigenvalues of Q [t), i.e. 

inf min \\[t) — \{t) \ > const > 0, 
te-f A(t) 

where the maximum is taken over all remaining eigenvalues of Q (t). The projection function to the corresponding 
eigenspaces 71 (t) is also analytic in t, and we may choose the eigenfunctions v [t) to be analytic perturbations of 
v{0) = 1. 

Continuity of Q (t) immediately gives us that in a neighborhood / of 



6 



Michael Bromberg and Zemer Kosloff 



Q{t) = \{t)-n{t) + N{t), (3.1) 

where supjg/ ||7V (t) || = 1 — 77 < 1. 

We proceed by evaluating the functions A (t) and 77 (t) for small t. By the structure of P = Q (0) discussed in 
the beginning of this section, we have 



A(0) = 1, 

v{0) = l, (3.2) 
77(0)(-) = ^,X0) = 75''(.). 

Lemma 1 If E'^ i-^o) = 0, then there exists a real nonnegative constant such that, 

A(t) = l-^t' + 0(|tl3), 

and 

77(t)(.) = 75''(.) + 0(lt|). 

Proof The statement concerning 77(f) immediately follows from Taylor's expansion and formula (|3.2|l . while the 
expansion of the main eigenvalue is carried out in 7, Lemma IV. 4']. 

Remark 1 It may be shown [71 Lemma IV. 3, pp 24-25] that a actually equals the asymptotic variance lim 



n— foo 71 



and therefore, a'^ = corresponds to the case of a degenerate limit for Wn- Since this case is excluded in the main 
theorem, in what follows, we assume that the results of the previous lemma hold with > 0. 



3.2 The connection between strong aperiodicity and the spectrum of Q{t). 

The next lemma connects the notion of strong aperiodicity with the spectrum of the characteristic function operator: 

Lemma 2 An aperiodic and irreducible Markov chain {Xn} is strongly aperiodic iff p{Q (t)) < 1 for all real t ^ 27rZ 
(p {Q (t)) the spectral radius of Q (t) ). 

Proof Note that since Q (i) is a finite dimensional operator of norm less than or equal to 1, p[Q (t)) < 1 is equivalent 
to demanding that Q (t) has no eigenvalues of modulus 1. 
If {X„} is not strongly aperiodic, we have 

e'*^ = A^44> ^x,y&S such that P''(y)>Q 
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where |A| = l,\f \ = 1, t ^ 2nZ or t £ I-eTL and ^ const. In the first case notice that, 

(Q (t) ^) {x) = f e'*V (y) (dy) = Xv^ {x) (3.3) 



s 



whence p{Q (t)) = 1 for t ^ 2nZ. 

In the second case ( t G 27rZ), since y G Z we have 



(Q(t)¥^)(x) = (O(0)^)(x)= / ^{y)P^idy) = Xpix) 



S 

This is impossible for non constant (p since we have a spectral gap property for t = (see the beginning of the 
section). This proves one direction of the iff statement. 

To prove the opposite direction observe that if equation H3.3p holds with |A| = 1 we have 

\v{x)\ = \{Q{t)p){x)\< [ \p{y)\¥^{dy) = iPM){x). 



S 

Since, 1 is a simple eigenvalue of P, we must have \ip\ = const and therefore, we may assume that \ip\ = 1. Hence 
since 

I e'*V(2/)P" idy) = \p{x), 
S 

and \Xlp{x)\ = Ifiy)] = 1, it follows from Proposition [3] in the Appendix that 

e**^'(p (y) = Xip (x) , Vx,ye S, with {y) > 

and the claim follows. 



4 Estimates. 

In this section we derive the main probability estimates needed to prove the main theorem. When lemma [T] is used, 
it is always assumed to hold with ^ > (see the remark that follows the lemma). 

Lemma 3 // {Xn} is strongly aperiodic, then for every S > 0, there are TV £ N, < < 1, c > such that for 
every n > N, t E [—t^, ti"] \ {^S, 5) , 

\\Q{tr\\<crl\ 

Proof Fix S > and t G [—n,n]\{—5,S). By strong aperiodicity (Lemma[2]), rt := r (Q (t)) < 1. 
Fix, rt < rt < 1 and choose no such that 

rt = inf ||0(t)"||" < ||Q(t)""p <n. 
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By continuity of Q (•) at t, there exists r] = rjt > 0, such that if r G {t ~ rj,t + rj), 



j|Q(rr|| <f,"°. 

For rz G N, write n = nom + k where k < uq. It follows from (|4.1|| that for every r G {t — i] , t -\- r]) , 
(T-) \\ < \\Q (t) ° \\ ■\\Q(T)\\<rt" ■\\Q(T)\\<rt hr — ■ 



(4.1) 



Setting ct = sup where the supremum is taken over all x £ {t — ri,t + rj) , k < uq we obtain 

||Q < ctf". 

Hence, for every t G [—n,n] \ {—S,S) , we can pick positive numbers nt, rjt,ct and rj < 1 such that for every 
n> nt and r G {t - rit,t + r]t), 

Since, [— 7r,7r] \ [—5,6) is compact there exists a finite sequence {ti}^_^ ; such that 

; 

l-n, n] \ {-S, S)c\J {ti - rit, ,t, + r,t,). 
1=1 

The result follows by setting = max {nt-} , rg = max {rt-} , c = max{ci.}. 

Lemma 4 // {Xn} is strongly aperiodic and {Xq) = 0, there exists a constant C such that for any initial 
distribution /i, n G N, x G 

P^(S„ = x)<-^. 

Proof In view of equation (|3.ip and lemma [T] there exist 5, a, rj > Q such that for t G {—5,5), 

Q{t) = \ (t) n{t) + N {t) 

where 

\\{t)\<l-at'', [|iV (f)" [I < (1 
By the inversion formula for Fourier transform. 



{Sn = x) = ^ I {Q (i)" 1) e'^'^'dt 



2n 



Et" {Q (0" l) e-'^'^dt 



Rs 



(4.2) 



(4.3) 
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By lemma |3l there are N£f^,0<rs<l,c>0 such that for any n > N, 

Q dt < Cy/nrs". 



2^ 



Therefore, the second term in (|4.3p is uniformly bounded in n . We proceed with estimating the first term in H4.3p . 



^ f Ef^iQ (t)" 1) e-**^dt 
2n J 



< # f \^(t)\''dt+y^ I \\N{tf\\dt 
2tt ' >^ / II II 



2n 



-5 
2(5 



(4.4) 



(4.5) 



It is obvious that the second term in (|4.5p tends to 0. To see that the first term is bounded, a change of variables 
t = gives us, 



S\/n 



S\/n 



2n 



ax 
n 



dx. 



dx 



Since, the last integral is uniformly bounded in n, this completes the proof. 

Lemma 5 (Estimation of the Potential Kernel, see IB}) If {Xn} ts strongly aperiodic and E'^ (Xq) = 0, then there 
exists C > such that for every a;, y G Z and s £ S, and initial distribution fi, 

oo 

[Sn =X,Xn=s)- {Sn = y , Xn = s)\ < C \x - y\ . 



Proof We denote by 74 (■) : S — >■ T the function e'*^'-* from the state space S to the circle T = {z £ C : \z\ = 1}. 

For simplicity of notation we assume that y = 0. The generalization to the case when y ^ is straightforward. 
Note that since x £ Z, its enough to prove that the term converges for every x and is 0(|a;|) as |a::| — >■ 00. 

By lemma [T] and equation (|3.ip we may fix 5 > and positive constants Ci, C2, C3 77 such that for t € {—5, 5) , 



\X{t)\ < 1 - C'lt'^ 
\3mX{t)\ < C2 
||7V(t)|| < 1-r, 
nit)i-) = E''{-) + e{t){-) 
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where ||e(t)|| < C3 • \t\. Set Rs = [-vr, tt] \ {-5,S) . 
By the inversion formula for the Fourier Transform, 



J2 {Sn = 0, X„ = s) - {Sn = X, Xn = s)\ 



n=0 

00 

E 



9iz ■ 



i2ny 



By lemma 13] there are positive constants no,c, < 1 such that for every n > no, t £ Rg, 

\\Qitr\\<crl 

Thus, 



00 „ „ 



1 



l_e-'*'^l -e"**^" dtidt2 



erg ■ 2 dtidt2 < 00 



Here Rg = [— tt, tt] \ (— 5, 5). It follows that 



E 



(Q (ii)" 7t.) • (1 - e"'*^") ■ e"'*^' dtirft2 i < 00 



(4.6) 
(4.7) 



which is enough for the statement of the lemma. Hence, it remains to estimate expression (|4.7p where the inner 
integration is carried over the set (—5, 5) . 

We have, 



E 



TT 8 



(2-) 



E 



+ E 



-71—6 

TT S 



(2^) 



E'' [Q (ti)" 7t.) ■ (1 - e-'*^") ■ e-"^^ dt.dt 

(A(ti)"i7(fi)7t.)-(l 
(iV (ti)" 7t,) ■ (1 - e-**i^) ■ e~'*^" dfidt 



-TT —5 



(4.1 
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Since, |jiV < 1 - t? < 1 and |7f (•)! = 1, we have 



E 



J •/ (2^) 

-7r —S 



- e~'''' dtidt2 



<^c'-(l-,7)"<C7'i (4.9) 



where C is some constant, which is again enough for our purposes. 
We proceed with estimating (|4.8|) : 



TT S 



{2ny 
1 

{2nf 
1 



-TT -5 
TT (5 



E" (A (fi)" n (ti) 7t,) • (l - e-"i^) • e-''^' dtidt2 



-7r-5 

TT 5 



{2nr J 

— TT —5 



i5'^(A(tO"-^(ii)(7t.))-(l-e-^*^") 



Since, -E'^ (7*2) = -E''^ ^6**^'''"°^ , by using the inversion formula and the Fubini theorem we obtain, 

A (ti)" E'' (7t,) ■ (1 - e-'*i") • e-**^^ dtidt2 



TT (5 



5Rc 



(2^) 



27r 



-5 



-<5 



< 2~ / l-^(*)r- (1-coste) df+;^ / |3m{A(t)"}| |sinta;| di. 



2-K 



(4.10) 



(4.11) 



By summing over n the first term in expression (|4.1ip and by our choice of 5, 
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Now, 



1 f 1 



2tt J Cif2 



(1 — costx) dt = O {\x\) , {\x\ — i> oo) 



and 



O 



Hence, from the integrand being an even function, we have 



E7^ \^ (01" ■ (1 - costx) dt = (\x\) , {\x\ oo) 



(4.12) 



To estimate the sum over n of the second term in expression (|4.1ip we note that, 



|3m{A(t)"}| < \3m\it)\-n\\{t)\" ^ < C2t^ ■ n (l - Cit'^J 
where the first inequality is easily seen to be true by induction on n. Therefore, 



— If \ f C \t\ 

pm{X{t)"}\\sintx\ dt < — / jsintej dt 



0{\x\),[\x\^^) 



(4.13) 



This completes the estimation of the sum over n of the first term in expression 1)4. lOp and all is left is to estimate 
the sum over n of the second term in expression (|4.10p : 



E 



TT 5 



B'^ (A (ti)" et, (7t.)) • (l - e-^*^^) ■ e"'*^^ dt^dt^ 



TT 5 



1 



.- n=0 



(2^) 

— TT —d 
TT S 

1 f f Cs 



— itix 



dt\dt2 



{2'itY J J Ci \ti\ 



1 -e 



— itix 



dtidt2 = O {\x\) , (|a;| oo) 



(4.14) 



The lemma follows by combining results (|4.9|l . (|4.12p . (|4.13p and (|4.14p . 
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5 Proof of theorem [2l 

Throughout this section we assume that {Xn} satisfies the assumptions of Theorem [2l 



5.1 A fourth moment inequality for Ln{x) — Ln{y)- 

Lemma 6 There exists C > such that for every x,y £ 7,, 

E^(^{Ln{x)-Lniy)f) <C-n-\x-y\\ 

Proof Set Zn = {Sn,Xn)- Throughout the proof we use the fact that for any initial distribution jj. on S, x,y £ Z, 
n, j G N, (j < n) and si,S2 € S, 

F^{Zn = {X,S2)\ Zj = = P^' {Zn-j ={x~ y,S2)) . (5.1) 

Let Iz {t) be the indicator function of the set {z} and set 

^ (t) = 1, (t) - ly (t) . 

We have 



((L„(x) - Ln{y)f) = E n ^(^*: 



where the summation is carried over all vectors i = (ii, 12, is, m) with coordinates equal to integers between and 
n. 

By symmetry, we may assume that ii < 42 < is < 24. For a fixed i 

i?" |^nv>(5,,)j =^(-iri5^(le,(5,J^(S.Jl5,(S.3)v>(5,J) (5.2) 

where the sum is carried out over all vectors ^ = (^1, ^2) with coordinates equal to either x or y and a=a (f) is the 
number of coordinates that equal y. 

Fixing i and f , and using (|5.1[l we obtain 

£^ (5,J^(S,Jl5, (S,3)V(S.J) =Es6S* [¥^'{Z,,={i^,sr))- 

F{il,i2,h)■{V'HS^,=^)~^"'{S,,=y))] (5.3) 



where 
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F{h,i2,i3) = r^{^,:.-n = {x - ^i,S2)}r' {Z,^^,, = {^2- X,S3)} 

-r^ = {y- Cl, S2)} P^^ {Z.3_., = (6 - y, S3)}] . 



At this point we take absolute values in (|5.3|) and sum over all vectors i obtaining 



1 



<E.e5^ E 

|-F(n,«2,i3)| ■ |a: - y 



where C is some constant. Here, Lemma|4]and Lemma[5]were used to obtain the last inequality and ii + 1 appears 
instead of ii, so that the expression will be defined for ii = 0. 
Note that, 

\F{H,l2,i3)\ < {Z,^^r, ={X^ il,S2)) |P^= {^.3-., = (6 - X, S3)} - V'^ {Z,^_,^_ = (^2 " J/, S3)}| 

+ P^^ {Z,3_,, = (6 - V, S3)} {^.,_,, ={X- S2)} - P'^ {Z,,-,, ={y- 6, S2)}| 

Substituting |_F(2i, Z2, ^s)! by the above expression, using Lemma[4lto deduce that sums of the type 

n 

Y,P^^{Z^ = {x,s)) 

k=0 

are bounded by constant times ^/n, and applying Lemma [5] we conclude that 



< C ■ n\x — y\^ 



Since there is only a finite number of possible vectors ^ in (|5.2|) (there are exactly 4) the claim follows. 
Corollary 1 For every x,y £S. 



Proof By Lemma [6l 



(J 

\tn{x) - tn{y)\ >e)<—\x-y\ 



The claim now follows by Chebychev's inequality. 
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5.2 Relative compactness of tn {x) in D. 

A sequence {Xn} of random variables taking values in a standard Borel Space {X, B) is called tight if for every e > 
there exists a compact K C X such that for every n G N, 

PniK) >l-e, 

where Pn denotes the distribution of Xn ■ By Prokhorov's Theorem relative compactness of tn{x) in D is equivalent 
to tightness. Therefore we are interested in characterizing tightness in D. 
For X [t) in D^_^ „^-^,T C m, m] set 

Uj: (T) = sup \x{s)~x{t)\ 

s,teT 

and 



uJx{S) := sup \x {s) - X {t)\ . 
\s-t\<S 

ujx (5) is called the modulus of continuity of x. Due to the Arzela - Ascoli theorem it plays a central role in 
characterizing tightness in the space C [— m, m] of continuous functions on [— m, m], with a Borel cr-algebra generated 
by the topology of uniform convergence. 

The function that plays in D [— m, m] the role that the modulus of continuity plays in C [— m, m] is defined by 

Lo'x{S) = inf max Lo{[ti,ti+i)) , 

{ti} l<j<U 

where {ti} denotes a 5 sparse partition of [— m, m], i.e. {ti} is a partition — m = t\ <t2 < ... < tjj+i = m such that 
min — ti\ > 5. It is easy to check that if i > 5 > 0, and m > 1, 

l<i<v 

^'x{5) < LOx (2(5) . 

For details see |3l Sections 12 and 13]. The next theorem is a characterization of tightness in the space D. 

Theorem 3 /3 Lemma 3, p. 173] (l)The sequence tn is tight in D if and only if its restriction to [— m, m] is tight 
in -D[— m.m] for every m £ R.)-. 

(2) The sequence tn is tight in £'[_m,m] */ o.rid only if the following two conditions hold: 

(i) Va; G [— m, m] , lim limsupP \\tn (x)\ > a] = 0. 

a ^oo n — ^oo 

(ii) Ve > 0, lim lim sup P (5) > el = 0. 

Remark 2 See (31 Thm. 13.2] and Corollary after wards. Conditions (i) and (ii) of the previous theorem imply that 



lim lim sup P 



sup \tn {x)\> a 
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Proposition 1 The sequence {tn{x)}'^_-^ is tight. 



Proof We prove that condition 2(i) liolds. 

Fix e > 0, a; G R. Since tlie Brownian Motion Wa{t) satisfies 



lim P sup \Wa{t)\ > A/ = 
M-i-oo yte[oa] 

and Wn (t) converges in distribution to Wa (t) tliere are M, no sucli that for all n> no, 



P'' sup \Wnit)\ >M] < e. 
\t6[oa] / 

By definition of tn [x) , it follows that if |a::| > M, n > no, 

P'^dtn (x)| > 0) < e. 



Now, if ja;| < M, by corollary [T] 



i\tn (x)\ > a) < {\tn (M + 1)\ >Q)+¥''{\tn{x)~tn {M + l)\ > a) 



< e + 



4C- {M+iy 



and the last expression can be made less then 2e for sufficiently large a. 

To prove condition 2(m) WLOG we may assume that m > 1. Since ijj'x{S) < lox (25), it is sufficient to prove that 
the stronger condition 



Ve > 0. lim lim sup 

(5— >0 n— >oo 



sup \tn{x) - tn{y)\ > e 

x.y^ [— ?n.m] ; — y | <5 







holds. 



Let e > 0. By Corollary [T] there exists C > such that for all x,y : < \x — y\ < 1 

¥^{\tnix)-tn{y)\>e)<^\x-yf. 
Let 5 > and n > notice that tn{x) is constant on segments of the form '^^) ' ^^'^^^ 

P'' ( sup \tn{x)^tn{y)\>4.e]< V ( sup \tn {kS) - tn ( ^ 

\x,vel-ni.ni]-\x~y\<S J n^^5|<,„ \kS^<]<{k+l)5^\ V V 



(5.4) 



(5.5) 



> e 
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By [S] Theorem 10.2] it follows from (|5.5p that there exists C2 > such that 



sup 

kS-/n<j<{k+l)S^ I 



\tn {kS) — t, 



(5.6) 



Therefore, 



5.3 Identifying to- (x) as the Only Possible Limit of a Subsequence of {tn {x)}j^^jq- 

Proposition 2 Assume that the sequence {Xn} satisfies the assumptions of Theorem\^ Let tn^ {x) be some subse- 
quence of tn {x) that converges in distribution to some limit q(x) . Then q(x) = ta (x). 

Proof Let g be a hmit point of {tn{x)}. i.e. there exists nj, — cxd such that tn^ =i q{x). 
By [101 Section 2], for every a, 6 £ R, the function on D[o.i] defined by 



/ l[a,6)(/)di 

Jo 



is continuous in the Skorokhod topology. 

Therefore, since Wn(t) ^ Wa{t) , for every a, 6 the random variables 



An{[a,b))= / l[a,b){Wn{t))dt 

Jo 

converge in distribution to the occupation measure of the Brownian motion defined by 



A{[a,b))= / 
Jo 



The local time to- of the Brownian motion is an almost surely continuous function of x such that for fixed a, b G 
the equality 

(5.7) 



I ta{x)dx= [ (Wa(t))dt 
J a Jo 



holds almost surely (see |11)). 

By straightforward calculations using definitions, we have 



l[a,6) {Wn{t))dt~ / tn{x)dx 



tn [x) dx + / tn (x) dx 



(5.8) 
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Now, 



tn (x) dx > 



< ( sup \tn{x)\>M 



+ 



Lv^°J+i 



tn (x) dx 



> e, sup \tn {x)\ < M 



The second summand on the right side of the above inequahty tends to since the integral is less than 
.The first summand is arbitrarily close to for M, n large enough, by Remark (2] Same reasoning applied to both 
summands of equation (|5.8p gives 







1 nb 
l[a,b) {Wn{t))dt- / tn{x)dx 



0. 



It follows that the distributional limits of l[a,6) {Wn{t)) dt and tn{x)dx coincide (see [3] Thm.S.lJ). There- 
fore, for every a, fe G R, 

f-b d 

/ tn{x)dx ^ / tcr{x)dx. 

J a J a 

For every a, b the function 

/ ga.bU) = / f{x)dx 



is a continuous function from D to R. Therefore, since <l{x) , it follows that 



tnk{x)dx ^ I q{x)dx 



Hence, 



q[x)dx = I ta{x)dx. 
J a 

Since the collection of functions ga,bj<^jb £ M generates G{D), it follows that 



q = to 



6 Proof of Borodin's Theorem (Theorem [TJ . 

We start by forming the mutual probability space on which, Wn and Wa are defined. 
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Let {ti} be a dense subset of [0, oo] and for each n let us regard the infinite vector 

:= {Wn, ln{tl,-), In (t2,-), ■•■) 

as a random variable taking values in the space 77 := _D+ x D^^ 

Since, a countable product of Polish Spaces is Polish, to prove convergence of the sequence {^n} we need to 
establish tightness and uniquely identify the limit. By Tichonov's theorem, tightness in each coordinate of the 
vectors separately (established in Theorem[2| implies tightness for the whole sequence {£,n}- 

To identify the limit, generalizing the method in the proof of proposition [2] to 71, for each sequence a = 
{{ui, we define a continuous function ga on 77 (taking values in x R'^) by 

/ fti 

(/,/ii,fe2,...) ^ /, [hi, 




The functions {ga} where a goes over all possible sequences of intervals in generate the Borel a-field of 77. 
Now, the arguments in the proof of proposition ©may be easily modified to show that 

ga (C«) ^ ga (C) 

where ^ := (W^, I (ti,-) , I (t2, ■) , ...) . This uniquely identifies the limit, establishing the convergence in distribution 
of the sequence to ^. Now, by Skorokhod's theorem (See |3] Theorem 6.7]), we may define processes ^'n : f^' — >■ 
on some probability space (j7',S',P) such that ^'^ and ^' have the same distribution as ^„ and ^ respectively, and 
such that almost surely, converges to Note that for n G N, by left continuity, for almost every oj £ J?', the 
vector 

= {W!j,ln {ti,x),l'„ {t2,x),...) 

uniquely determines a function l'n[t,x) : [0,1] x (—00,00) — >■ R, which coincides with the coordinates of for 
i G fl'iid is Cadlag in each variable. 

It is clear that the functions I'n {t,x) are a.s equal to the local time of Wn- Similarly, the vector ^' uniquely, 
determines a function I' {t,x) which a.s equals the Brownian local time of W^, and is therefore continuous. The a.s. 
convergence of ^'^ to ^' implies a.s. convergence in the Ji topology of Wn to W^, thus proving (2) of theorem [T] 

It remains to prove that I'n, l' , n = 1,2, ... satisfy the statement in (3). To see this fix T > 0. For Ti > 0, whose 
value is to be determined later, we extract from {tj} a finite partition of [0,T] with mesh less than h and denote it 
by 

T : = io < ii < ... < = 1. 

Now for i = 1, .., I, the process i'n {ti, •), a.s converges to /' {ti, •) in the metric of the space D. Since, the limit is a 
continuous function, by properties of the Ji topology, this convergence must be uniform on compact subsets of R. 
We may conclude that for every compact subset C R , every e > 0, and almost all uj £ Q' , there exists A^o, such 
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that for every n > A'^q, 

sup \l'n {t,x) — l' {t,x)\ < e. (6.1) 
x(£K,teT 

Now, by monotonicity of the local time as a function of time, if I'n [t, x) — l' (t, x) > then 

I'n {t,x) - l' {t,x) < I'n - l' {ti,x) 

and if I'n {t, x) — I' (t, a;) < then 

l' {t,x) - I'n {t,x) < l' - i'n {ti,x) 

where t^, t^^i are points in T satisfying 

ti < t < ti^i. 

Hence, 

sup \l'n{t,x)~l' {t,x)\>2e] <¥[ sup \Wn\>M]+¥i sup |V1/^|>M) (6.2) 
te[o,il,a;eM / \te[o,i] / \te[o,i] / 

+P( sup \l'n{t,+i,x)-l' {ti,x)\> e] (6.3) 

\i,xe[~M,M] J 

+P( sup |4(t„x)-Z'(t,+i,x)| >e) (6.4) 
\i,xe[-M,Ai] J 

where i = 1, ...l. 

As in the proof of Proposition ^ expression (|6.2p is small for sufficiently large M. Expressions (|6.3|) and (|6.4|l 
are handled similarly. We have 

sup \l'n{ti+i,x) - l' {ti,x)\ > e] < F I sup \l'n{ti+i,x) ~ l' {ti+i,x)\ > ^ 

i,xe[-M,M] I \teT.xe[-M,M] ^ 



+P ( sup |Z' (ti+1,3;) (4^,1)1 > 



i=0,l...i, X 



The first expression on the right equals for all n sufficiently large, by 16.11 The second expression, by a.s. 
continuity of Brownian local time, can be made arbitrarily small by taking h to be sufficiently small. This concludes 
the proof. 



7 The periodic Case 

Let X\,Xi, .... be an i.i.d. sequence in the domain of attraction of the Gaussian distribution. In this setting Borodin 
proved convergence of local times under the condition of what we call non-arithmeticity of the random walk Sn, that 
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Our notion of strong aperiodicity in the i.i.d case is equivalent to the stronger condition that 

Ig/g^txAl = X <^4. t e 27rZ. 



In this section we show that the methods of this paper are sufficient to replace the assumption of strong ape- 
riodicity by a weaker non-arithmeticity in the i.i.d case and for Markov chains that are almost onto (see section 

We assume that E {Xi) = and that 

E := {a;|P {Sn = x) > Q for some n) = Z. 

Otherwise, sinceX" is a subgroup of Z, in the recurrent case, we'll need to relabel the state space. 
Let 

p = inf {fc e N : P(S'fe = 0) > 0} 
be the period of the random walk. It follows that 

|i5(e'*^)[=l ^t€^Z 

In this case the random variable Xi takes values in a proper coset of Z. The periodic structure of Sn is that for 
n G N and k £ {1, ...,p — 1}, S^p+k takes values in one of the p — 1 cosets of Z of the form pL + j, j = 0, ...,p — 1. 
In this case the potential kernel estimate( Lemma [5]) should be corrected to state that for every a;,y £ Z, 



p-i 



P {Snp+k = x)~v {Snp+k = y) 

fc=0 



<C\x-y\, (7.1) 



which is a special case of the corollary from lemma 7 in [8]. Lemma |4] also holds in this case (see Lemma 2 in [8]). 
These two ingredients are enough to prove the fourth moment inequality, Lemma [S] To see how this is done notice 
that (here we keep the notation of Lemma [6]) 

i5(l^,(5,JV^(S,J 1^,(5,3)^(5, J) = [F{S,^=^,)-F{h,i2,i3)- (7.2) 

(P(S,,_,3 =a.)-P(S,,_,3 =2/))] 

where 

F{il,i2,i3)= [P{S^,-^, = X - ^i) F {S^,^.,^ = ^2 ^ x) (7.3) 

-P(S,,_,, = y-Ci)P(S,3_,, = 6-y)] (7.4) 
= P (S,,_,, = X - Ci) [P (S.3-.. = 6 - ^) - P (S,3_,, = C2 - y)] 
+P(5,3_,, =6-y) [P(S,,_,, =a;-ei)-P(S,,_,, =y-6)] 
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Therefore, since 



from (17.21) and (17.31) it follows that we need to estimate two sums. The first is 



E 

ii = l L 



'(Sn =Ci) E =^-^i) E {P(S»3 =6-a.)-F(S.3 =C2-y)} 

43=0 

n — 21—22—13 

5^ {P(S,, =:r)-P(S,, =y)} 



(7.5) 



44 = 



In order to bound this term we first notice that 



"-21-22-43 L("-4l-«2-23)/pJ p- 1 

24=0 (=0 i=o 

here a = 6 ± c means |a — 6| < c. We do a similar rearrangement to the sum of 13. It then follows that the term in 
(|7.5|) is strictly smaller than 



E 



'(^21 =6) E P(522 =X-6)- \P+ E 
22=0 \ il=0 



p-1 



J2 {P (^23 = - x) - P (5,3 = 6 - y)} 



Ji=0 

-1 



p+E 

i ;=o 



^{P(S,.p+,=a.)-P(5z.p+,=j/)} 

j=o 



The conclusion follows from a double application of the inequality (|7.ip and the bound in Lemma 2 of 8\. The second 
term is dealt with similarly and the rest of the proof of Borodin's theorem remains the same. Thus we have: 

Theorem 4 Let Xi,X2, Xn, ■■ be an i.i.d sequence with E {Xi) = and E (X^ ) = 1 such that the random walk 
Sn is recurrent. Then there exists a probability space (X',S',P') and processes Wn, : X — >■ D+ such that: 

1. Wn = W^;W = W'. 

2. With probability one W^ converges to W' uniformly on compact subsets of [0,oo). 

3. For every e,T > the processes I'n {t, x) and l' [t, x) defined with respect to Wn and satisfy the relationship: 

lim P' ( sup \l'n{t,x) ~l' {t,x)\> e\ =0. 

n->-oo \ tg[o,T],a;eK 



7.1 The periodic case of finite state Markov chains 



To drop the assumption of strong aperiodicity when X\, .., Xn, ... is a Markov chain we use the dynamical setting 
introduced in section 1. Let P : S x S — ^ [0, 1] be the transition matrix, fi be an initial distribution on S and the 
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probability measure on 5*^ generated by ^ and P. We then look at the Markov shift (^S^ ,B.P^ where T is the 
shift and B is the Borel u-algebra generated by the cylinder sets 

[soSi...s„] = ^^uj e : oji = Si, i = 0, 1, n| . 

In this case Xn = f {T"'uj) = uin and if the function / is periodic there exists a solution to 

where either t ^ 27rZ or tp is not constant. To make the same analysis as for random walks we need to exclude 
the case tp ^ const (then summation over the Markov Chain will yield the same periodic structure as in the i.i.d 
case). A sufficient condition for that is that the system {X,B, P^,T,a) is almost onto with respect to the partition 
Q = {[so] ■ So G 5'}, meaning that for every a,b £ a there exist sets ao,...,On such that ao = b, an = c and 
Tak n Tak+i ^ (for details see O Section 3]). 



8 Applications to complexity of random walks in random sceneries with a Markov chain base 

A Random Walk in Random Scenery is a skew product probability preserving transformation which is defined as 
follows: 

The random scenery is an invertible probability preserving transformation [Y,C,v, S) and the random walk in 
random scenery {Y,C,v, S) with jump random variable ^ (assumed Z-valued) is the skew product [Z,B{Z),m,T) 
defined by 

Z ■=nxY, m:= ^^xv, T{w,y) = {Rw,S'^°y) 

where 

(^?,Z3(^2),/i^,i?) = (^z^^ ,]^distc, shift j 

is the shift of the independent jump random variables. 

Aaronson [T], assuming ^ is in the domain of attraction of an a— stable law with a > 0, has studied the relative 
complexity and the relative entropy dimension of T over the base. We refer the reader to [T] for the definitions. 

One can ask if Aaronson's result [T] Theorem 3, Section 1] remain true if we change the base {^Q,B{fi) ,fi^,R^ 
to a strongly aperiodic, irreducible, finite state Markov Shift {n,B{0) jP'^yR). 

With Theorem [T] at hand, Aaronson's proof, which can even be simplified since the Brownian motion is a.s 
continuous, can be carried out verbatim. 

9 Appendix 

Proposition 3 Let {X,B,^) be a probability space, f : X ^ (the unit sphere) measurable. Then 

I f {x) d/.| = 1 
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implies f = const. 

Proof Assume that / is not constant. Then there are two disjoint intervals /i,/2 ^ T such that /i (/^ (^i)) > 
and n (/"^ (7i)) > 0. It follows that 



1/ f{x)dJ< 
\Jx I 



f{x)dtj,+ / fix)dfi 



This is true since if for ji £ {1, 2} 



then it is trivial, else 



< 1 



and the mean of two different values on the unit sphere is of modulus strictly less than 1 . 
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